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PROJECT 1. CLEARINGHOUSE ON ACADEMIC ACHIEVEMENT 



Principal Investigaton Fred M. Newmann 
Project Staff: Lorene Folgert, Madge Klais, Anne Lockwood 



Summary of Activities 

The publication of syntheses and the bibliography were completed in the last quarter. 
Because of many requests for the bibliography, an additional 200 have been printed. During 
this quarter, 52 copies have been mailed in response to requests. 

Madge Klati has left the staff, and Lori Folgert has assumed the responsibility for maintaining 
the library and mailing copies of requested documents. 
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PROJECT!. NONINSTTRUCnONAL INFLUENCES ON ADOLESCENT 
ENGAGEMENT AND ACHIEVEMENT 

Principal Investigators: B. Bradford Brown and Laurence Steinberg 
Project Coordinator: Susie D. Lambom 
Project Staff: Diane Kohrs, Elizabeth Kraemer, 
Nina Mounts, Mark Phllipp, Joy Wiggert 

Summaiy of Activities 

The cleaning, coding, and data entry of inforni9tion from the last survey (Spring 1990) from 
the California schools are completed. The surveys are currently in the scanning stage at the 
scanning company location. We expect to receive these data in late September. Data entiy 
of self-report crowd membership and the daU from the social type rating interviews for both 
the California and Wisconsin schools are complete. 

Tentative Findings 

We compared levels of academic effort and values of four groups of students differing in both 
achievement level and invohrement in schcol misconduct: nondelinquent high achievers, 
delinquent high achievers, nondelinquent lo*^ achievers, and delinquent low achievers. As we 
expected, there were clear distinctions in academic outcomes for students with high grades 
who varied in their involvement in school misconduct, even after controlling for the effects 
of SES. Compared to the delinquent high achievers, nondelinquent high achievers report 
higher engagement in learning, have a stronger orientation towaids school, feel more strongly 
bonded to teachctrs, and have higher academic self-esteem. They also have a stronger work 
orientation and suffer from fewer psychological and somatic symptoms. The analyses indicate 
that students' willingness to participate in school misconduct is a sign of a broader devaluing 
of the educational process, regardless of adolescent achievement levels. 

For th ; most part, delinquent high achievers and nondelinquent low achievers have outcomes 
that are weaker than the nondelinquent high achievers but stronger than the delinquent low 
achievers. Compared to the nondeliLquent low achievers, the delinquent high achievers have 
higher educational &.«^^pirations, spend more time on homework, have higher self-esteem, and 
are more self-reliant However, they are sAno lower on several important indicatora of school 
involvement: academic engagement, school or-^ntation, and bonding to teachers 

Individuals who participate in school deviance appear not to value school or to take it 
seriously when compared to nondelinquent peers, even when their performance levels are 
high. These high-achieving but deviant students are providing schools and parents with 
desired academic competence and many of their detdant activities are likely to go undetected 
or to be overlooked. These students do well academically, but how well they are learning is 
questionable. 
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Deliverables 



We are currently working on the three Qnal delh«rables: 

1. Practitioners' report based on year 1 findings. This report will take the form of a chapter 
for a book on engagement that the whole Center is working on together. 

2. Fmal report of the project titled "T^oninstnictiona] influences on academic achievement 
and student engagement" This will be a more elaborate version of the book chapter with 
statistical details. 

3. Report of longitudinal finding^. We have begun kmgitudinal analyses examining lagged 
effects of three parenting dimensions (parental encouragement, parenul involvement in 
schooling, ind parenting ftyle) on various school outcomes (e.g., GPA, engagement, 
orientation to school, academic self-esteem). 
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PROJECT 3. THE STRATniCATION OF LEARNING OPPORTUNITIES IN 

MIDDLE AND HIGH SCHOOL 

Principal Investigaton: Adam Oamoran and Martin Nystrand 
Project Staff: Mark Berends, Dae-dong Hahn 

Summaiy of Activities 

This quarter was devoted mainly to two activities: writing and presenting papen at 
professional meetingii, and improving the coding of our ninth-grade observational data for use 
in multivariate analyses. We are also working on our chapters for the Center book on 
engagement These chapters will be finished this fall One will explain the importance of 
authentic discourse for student engagement and achievement The second will show how 
ability grouping structures students' opportunities for engaging instruction. 

Tentative Findings 

As indicated 'ast quarter, Gamoran revised the June deliverable "Access to excellence: 
Assignment to honors English classes in the transition to high school" for presentation at the 
August meeting of the American Sociological Association. The revised veision, which is 
included with our progreu report adds new information. One important contribution is that 
it quantifies the impact of eighth-grade track assignment for ninth-grade placement High- 
achieving students were more than 80% likely to end up in the honors ninth-grade class if 
they had betonged to a high-ability class in eighth grade, but their chances were less than 45% 
if they had net already obtained that rank. Based on comments received at the meetings, this 
paper is undergoing hirther revisbns prior to submission for publication. 

Findings from Berends' paper "High school tracking and students' school orientations," which 
was presented at the same conference, were described in our first quarter 1990 progress 
report 

Gamoran also presented his paper with Nystrand, "Tracking, instruction, and achievement" 
2i the World Congress of Sociobgy in July. The paper reporU that differences in the quality 
of instructional discourse and in student responses to instruction account for about 25% of 
the high-track advantage and 35% of the k>w-track disadvantage, compared to students in 
"regular" classes, in eighth-grade English. This paper is included with our progress report as 
a draft 

In June, Gamoran presented "Authentic discourse iu a nonformal educational setting: The 
Jewish summer camp" at the annual meeting of the Research Network on Jewish Education. 
This paper argues that the structure of nonformal settings such as the summer camp is more 
conducive to authentic discourse than traditional schools. The results of an observational 
study are consistent with this claim, showing, for example, that instructors in a camp "lesson" 
asked over 60% authentic questions, compared to only 'i 1% of the questions in our study of 
eighth-grade English classes. This paper is also included as a draft 
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PROJECT 4. HIGHER ORDER THINKING IN THE HIGH SCHOOL CURRICULUM 

Principal Investigator Fred M Ncwmann 
Project Staff: Dae-Dong Hahn, Bruce King, Jim Ladwig, 
Don Libby, Fran Schrag 

Sommaiy of Activities 

Final stages of data analysis have begun as we examine the relationship of classroom 
thoughtfiSness to student achievement and to student engagement, and the role of teachers' 
thinking, school organization, and leadenhip in the promotion of classroom thoughtfulness. 

Project staff met in June to outline final writing projects which include a prospectus for a 
monograph on the project and articles on student achievement (Newmann), barriers and 
teacher thinking (Onosko), and organization and leadership (Ladwig and King). 

We developed a symposium proposal for the AERA Special Interest Group on Research in 
Social Studies Educatk)n for the April 1991 conference. 

Newmann completed *The Prospects for Qassroom Thoughtfulness in High School Social 
Studies" for pubUcatk)n as a chapter in C. Collins & J. N. Mangieri (Eds.), Building the 
Oualitv of Thinking In and Out of Our Schcxih in the Twentv-Firet Century. HUIsdale, NJ: 
Lawrence Erlbaum Associates. 

Tentative Findings 

I. Student Engagement Gassroom thoughtfiihiess is strongly associated with student 
engagement In additksn to the several points made by Stevenson in his dissertation on phase 
I data, phase n and phase in now offer the foUowing additional suppc^rt for this association 
(analyses of phase III qualitative data are not yet completed). 

(a) Observer! rated the level of thoughtfiihiess and also the level of student 
engagement for 479 lessons in 16 high schools (all three phases of the study). The 
correlatk>n between the two was .57. 

(b) Students indk»ted how engaged they were in their social studies class and how 
much it challenged them. The correlation between these ratings was .55 (N » 1315 
students in 11 high schools, phases II and III of the study). The same survey for 
eighth graders in 16 schools produced a correlation of .66 (N » 1819). 

(c) Comparing the top 25% to the bottom 25% of the classes on observer-rated 
engagement we found that students in the top classes reported signiflcantly more 
cognitive challenge (about 1 point on a nine-point scale or about half a standard 
deviation). Conversely, comparing the top 25% to the bottom 25% of the classes on 
observer-rated classroom thoughtfulness, students in the more thoughtful classes 



reported more engagement (more than half a point on a nine-point scale, or about 
J standard deviation). (Phase m data, N » 20 classes) 

(d) When students indicated which subjects (English, social studies, science, math) 
they found most engaging and most challenging, the four correlations ranged from .60 
to .69 (N 3> 48 students, phase m only). 

(e) Students were asked to rate how quickly time passed and how hard they were 
challenged to think while participating in Qve different cognitive tasks (e.g., justifying 
or defending your answer or opinion; recalling facts; describing your eicperiences). 
Correlations between engagement and challenge on four of five items ranged between 
36 and .47 (N > 48 students, phase m only). 

Although we have not been able to demonstrate that cognitive challenge actually causes 
engagement, these findings are consistent with that interpretation. 

2. Student Achievement In Phase III, students were given a pretest and posttest asking 
them to state in writing and to persuasively defend their views on the constitutionality of 
certain actions by school authorities, based on reading material given with each test. The 
pretest involved principal censorship of a school newspaper; the posttest invoked a locker 
search by the principal We found (a) no overall improvement from pre- to posttest; and (b) 
that after controlling for several background factors and the pretest, classroom thoughtfuhiess 
was not related to students' scores on the posttest 

These findings call for interpretation that we are beginning to formulate. The over-all lack 
of improvement is not surprising, because none of the classes focused instruction on 
persuasive writing about constitutional issues. Instead, the classes wc. observed dealt with 
more familiar social studies content especially knowledge of historical events, institutions, and 
trends. Since the test calls for complex sldlls and in-depth understanding, we would not 
expect students to improve without some instruction related to the exercise (we are studying 
the possibility that the posttest was generally more difficult for students than the pretest). 

Our indicators of classroom thoughtfulness assessed neither the teaching of persuasive writing 
nor constitutional understanding, but we were interested, nevertheless, in whether the general 
qualities of careful thought they did detect might enhance student performance on the 
constitutional writing exercise. Phase II data supplied surprisingly affirmath« findings on this 
issue, for even after controlling for several background factors (including student grade-point 
average and ability level of class), as well as for pretests of social studies knowledge, and for 
general writing ability, classroom thoughtfuhiess was strongly associated with the posttest 
score. In phase m, controlling for student background, but not for the new, more rigorous 
pretest we also found that itudent posttest score was associated with classroom 
thoughtfuhiess, consistent with phase II findings- But when we added the nearly identical 
pretest to the phase HI regressions, the effect of classroom thoughtfulness disappeared. 
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Apparently, classroom thoughtfulness as we have defined it offers no special benefits for 
student success in writing persuasively on constitutional issues beyond what would be 
predicted through a pretest score on a similar exercise. The most likely reason for this is that 
our indicators of classroom thoughtfulness simply did not detect specific kinds of instruction 
relevant to success on the task. The best predictors of student succeu were the student's 
grade-point average, pretest score, ability level of the class, and the grade level of the class 
(9-12)~all of which showed about equal impact (standardized regression coefficients of about 
.2). But even with all these variables (plus student sex and race and parental education) iu 
the regression, only 38% of the variance in posttest scores was explained. There is much to 
learn about what contributes to student success in writing persuasively on constitutional issues 
when instruction focuses on other matters. 

Given the strong association between cognitive challenge and engagement, it is possible that 
classroom thoughtfukiess might have a stronger relationship to achievement when tested more 
conventionally in social studies classes. That is, if students are more engaged in the more 
thoughtful classrooms, presumably they would learn more of whatever is taught We will 
explore ways of using other daU to investigate this. 

Deliverables 

We promised two deliverables at the end of this project (see p. 27 of Application for 
Continuation, September 26, 1989): a "monograph" on the prospects for HOT in high school 
social studies and an article on organizational innovation and higher order thinking. The 
latter will be completed by Jim Ladwig and Bruce King. For the former, we are pursuing the 
possibility of a book-length monograph but, at this date, have no commitment from a 
publisher. To insure that a general summary of the project consistent with this theme is 
delivered to 01 :RI by the end of the grant, we will submit the following three documents as 
the "monograph" deliverable: Newmann's chapter in the Collins book listed in Summary of 
Activities; Newmann*s chapter on the HOT project in the Center book (Ch. 5 "Higher Order 
Thinking and the Pkospects for Gassroom Thoughtfulness"), which will also include material 
on student engagement; and an article by Onosko on Barriers to Higher Order Thinking in 
High School Social Studies. 



PROJECTS. RESEARCH ON PROGRAMS AND POUCIES AFFECTING 

AT-RISK YOUTH 

Principal Investigator. Gaiy Wehlage 
Project Staff: Lorene Folgert, Don Libby, 
Pauline Lipman, Greg Smith 

Smnmaiy of Activities 

This quarter has been devoted to analyzing quantitative and qualitative data from the Casey 
Foundation's New Futures project A portion of the second year of longitudinal cohort data 
has been prepared and will soon be made available for all four districts. This permits 
comparison between 1968-89 and 1989-90 on a number of variables. Available at this time 
are daU on enrollment, attendance, achievement (reading and math), and suspensions for all 
district schools as well as those taking part in the New Futures Initiathre. Yet to be made 
available are data on dropouts, coutm failures, and retentions because of the need to analyze 
summer school results to accurately report on these variables. The Management Information 
S><stems that were developed as part of the initiathw are functioning very well, and few 
serious problems were encountered in generating the data. 

An effort was made to further clarify and conceptualize the standards used to evaluate 
institutional change in New Futures schools. The enclosed paper, "A Good School," was 
written to provide a clearer vision of what New Futurfs hopes to achieve in school reform 
and restructuring. This paper is not a deliverable but ii is enclosed for your information. It 
will be revised and submitted for publication. 

Tentative Findings 

"A Good School" ofTera a set of seven standards that form criteria for judging the extent to 
which schools are making substantive changes likely to improve the quality of school for 
students and teachers. The seven standard:: for school reform are school membership for 
students, engagement in intellectually challenging curriculum, authentic asessment of 
academic achievement, moral commitment to at-risk students, reflection by educators, 
empowerment of staft and strengthened school resources. 

Deliverables 

The above standards will be used to organize data that have been gathered during the past 
two yean into a paper of major findings across the four New Futures sites. Tnis paper will 
be the final deliverable from the project to OERL 

Also enclosed is the final report on the Oakland academies, "Providing Options for At-Risk 
Youth: The Health and Media Academies in Oakland." This was submitted by staff from the 
Far West Lab as a deUverable from their subcontract (originally due November 30, 1989). 
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A number of conversations were held between Lany Guthrie and Wehlage about the 
contents of the report Specifically, it was agreed there was a need to have longitudinal data 
for studenu in the academies. The purpose was to compare academy students with non- 
academy students on outcome measures and to determine the dropout rate within the 
academies. Some of these daU are found in the report, but the authoi^ had great difficulty 
obtaining information from the schools, and there gaps in the report For example, 
achievement scores could not be obtained; dropout data were not made available. These 
limitations and the absence of rich ethnographic descriptions have led us to conclude that this 
report is not of publishable quality. 
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PROJECT ALTERNATIVE STRUCTURES AND THE 
QUALTTY OF TEACHERS' WORKUFE 

Principal Investigaton Karen Seashore Louis 
Project Staff: Stewart Puricey, Sheila Rosenblum, 
Richard Rossmiller, BetsAnn Smith 

Snmmaiy of Activities 

Project staff ff in Minneapolis, for a two and a half day analysis seminar, on June 13-lS. 
The discussion .jcused on analysis of the survey data and the implications for proposed 
papen/chapters, on the final two teaching case studies, and on plans for a Center newsletter. 
Authors of various papers also met in small groups. In addition, Richard Rossmiller, Sheila 
Rosenblum, Karen Seashore Louis, and BetsAnn Smith met in Minneapolis on September 
S and 6 to make final preparations to produce the final report chapter on school leadership 
and teacher quality of work life. 

Tentative Findings 

Preliminary findings from the survey data: 

(1) Internal reliability of the seven scales to measure Teacher Quality of Worklife (TQWL) 
was confirmed (Cronbach a 2 .6 or above). 

(2) A slightly revised model waii used to analyze the relationship between the TWQL 
variables and teacher engagement Based on our qualitative data and previously reviewed 
theoiy, respect was treated as a possible contrib\*tor to, rather than the defining criterion for, 
other aspects of TQWL, and correlations from 35 to .58 supported this. Similarly, supportive 
principal leadership was also viewed as contributor to TQWL. A canonical correlation 
between respect/principal support and the TQWL dimensions produced a coefficient of .78. 
There were about 300 teachers in these analyses. 

(3) Regressions indicate that TQWL dimensions do have some ijipact on teachen' attitudinal 
engagement The most critical TQWL features are effective feedback on performance, 
opportunity to use and devetop skills, respect and level of resources. 

(4) Teachers who report high TQWL are much more likely to have a higher sense of efficacy 
and less likefy to have negative attitudes about student behavior and academic potential In 
the regressions, all TQWL dimensions were associated with sense of efficacy, and four of the 
seven related to negative attitudes toward studenU: perceived influence, feedback, level of 
resources, and congruence between personal and school goals. 

(5) Behavioral engagement (measured by the amount of time that teachers work outside of 
their contract time) was viewed as a function of attitudinal engagement TQWL, attitudes 
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about student potential and sense of efficacy, but regression indicated ttslati-rely weak 
connections (R'^ * .12). 

(6) According to an analysts of variance, teachers in schools with a high proportion of low 
SES students experience generally lower TQWL: the differences are significant for r;4pect, 
coUegiality, level of resources, and feedback. Teachers in these schools also have a lower 
sense of efBcacy and more negative attitudes about students. There was no difference in level 
of perceived influence, the ability to use and develop skills, or goal congruence. However, 
proportion of k>w SES students was not associated with teacher attitudinal or behavioral 
engagement 

(7) The more radical the restructuring of the school, the higher the level of TQWL, for all 
six dimensions. 

Deliverables 

The two teaching cases, which compare problems of restructuring to improve teachen' work 
in new and existing schools, are enclosed as DRAFT deliverables. After being reviewed, they 
will be revised and enclosed as final deliverables by the end of the next quarter. 
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iNsnrunoNAL functions 

Fred M. Newmann, Gaiy G. Wehlage, 
Anne Turabaugh Lcxkvvood, Deborah M. Stewart 

Don libby 

Goveraancc-AdminlstntloB 

There have been no major issues to consider regarding governance or administration of the 
Center. A no-cost esctension for three months has been requested from OERI to complete 
the work. 

Newmann has worked with principal investigators to coordinate writing of the final 
monograph. 

As a result of discussions with principal investigators and Richard Wallace, Chair of the 
National Advisoiy Panel, we have decided to alter the format for receiving National Advisory 
Panel help this year. Panel memben will be invited to evaluate parts of the book and final 
report Emphasis will be placed on written reviews and phone conversations, and in addition 
a meeting will be held sometime between November and January to discuss panel members' 
reactions. Since the book and final report will summarize the Center's five year's of work, 
the Panel's evaluation of these will constitute an evaluation of the Center. 

Dissemination 

The first Fall newsletter has been completed and will be mailed in early October. Its topic: 
Restructuring and Quality of Teachers' Worklifs. Karen Seashore Louis wrote the lead 
article "The Problem of Teachers* Work" and a "Summary Discussion of Key Fmdings" from 
the project Lockwood edited two cases of schools in the study from material developed by 
Sheila Rosenblum and Richard Rossmiller. 

Iwockwood wrote two brief summaries of research syntheses that will be published in the 
NASSP Bulletin this fall. One describes Curry's synthesis on learning styles; the other, 
Slavin's synthesis on ability grouping in secondary schools. 

R&D Preview will publish a summary of Slavin's synthesis this fail Educational Research 
Service's Bulletin (September 1990) featured Slavin's synthesis in a brief feature article. 

Educational Leadeishio will highlight Cuny's synthesis at the end cf an article by her that will 
be published this fall. 

Wehlage's presentation in Smithtown, RI, was the subject of a feature article in The Regional 
Lab Reports (June 1990). The article, "Make Achievement Authentic," described the first 
phase of the at-risk students project's research in special schools for at-risk students. 
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The paper "Staff Development for Higher Order Thinlang: A Synthesis of Practical Wisdom" 
by Fred Newmann, Joseph Onosko, and Robert Stevenson was published in The Journal of 
Staff Develooment 11(3), 48-55 (summer 1990). 

Fred Newmann made a presentation on authentic assessment to an institute of the National 
Center for Effecthre Schools Research and Development, Chicago, June 22. 

Adam Gamoran and Mark Berends made presentations and presented papers as follows: 

Gamoran,A (1990, June). Authentic discourse in a no nformal educational setting: 
The Jewish summer camp. Paper presented at the annual meeting of the 
Research Network on Jewish Education, New York. 

Gamorw, A, & Nystrand, M. (1990, July). Tracking, instr uction and achievement 
Paper presented at the Worki Congress of Sociology, Madrid. 

Gamoran, A (1990, July). The variable effects of tracking: Productivitv and 
inequalitv in A merican high schoob. Presentation to the Centre for 
Educational Sociotogy, Edinburgh. 

Gamoran, A (1990, August). Access to exc ellence: Assignment to honors English 
classes in the transition to high school. Paper presented at the annual 
meeting of the American Sociok)gical Association, Washington, DC 

Berends, M. (1990, August). High school tracking and stu dents' school orientations. 

Paper presented at the annual meeting of the American Sociological 
Association, Washington, DC 

Karen Seashore Louis and Matt Miles' book, Improving the urban high school: What works 
and whv. was published by Teachers College Press. 

National Leadership 

Fred Newmann discussed our work on student engagement and other issues in advising the 
National Center on Education Statistics on areas to include in the 1992 follow-up of 
NELS:88, Washington, DC, June 4. 

Newmann consulted with teams of teachers and administrators from six districts as part of 
Project 2061's devetopment of curriculum models. On July 5, 9, and 23 he addressed the 
topics of social studies, assessment, and organizational restructuring during the Project's 
summer institute in Madison, WL 

Newmann consulted with the CHART project funded by the Rockefeller Foundation on the 
issue of authentic assessment, Philadelphia, July 26 and 27. The Philadelphia project invohres 
interdisciplinary efforts to bring humanities into the teaching of high school history. 
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Wehlage conducted a two-day workshop for the Oakland, CA, Media Academy teachers to 
help their staff develop intervention strategies for at-risk students on August 27-28, in Tahoe, 
NV. 

Rossmiller attended meetings of the National Council of Professors of Educational 
Administration, August 12-16, at California State Unwenity, Los Angeles, CA. 
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Project 5. Rescarck oa Programs tad Policies AffcctI if At-risk Youtk 

Guthrie, L F., Guthrie, G. P., van Hemden, S. (19QC). Providing options For at-risk youth; 
The Health and Media Academies in O akland. Final Report. San Francisco: Far 
West Laboratory for Educational Research and Devek>pment 

Project 6t Altenativc Structures aad tbe Quality off Teac^T.V V/orkliffe 

Rosenblum, S.. Rossmiller, R.. Louis, K.. & Smith, B. ^990). A tale of two schools and 
teachers' work: Reforming a traditional school-desiming a new stHqoI. Madison, 
WI: Natk)nal Center on Effectwe Secondary Schools. (DRAFT) 

B. Other Publlcatioos: 

Project 2. Noniaitmctional Influences on Adolescent Engagement and Achievement 

Lambom, S. D., & Steinberg, L. Emotional au tonomy redux: Revisiting Rvan and Lvnch. 
Madison, WI: National Center on E£fecth« Secondary Schools. (Submitted for 
Publication) 

Praject 3. The Stratifkatton off Learning Opportunities in Miiddle and High School 

Berends,M. (1990). High school tracking and stu dent*' school orientations. Madison, WI: 
National Center on Effecthw Secondary Schools. (Submitted for publication) 

Gamoran, A. (1990). Access to excellence: Ass ignment to honors English classes in the 
trfln«it|9n from mkldle to hiyh school Madison, WI: National Center on Effective 
Secondary Schools. (DRAFT) 

Gamoran, A. Authentic discourse in a nonformal educational sett ing: The Jewish summer 
camp . Paper presented at the annual meeting of the Research Network on Jewish 
Education. New York, June 1990. (DRAFF) 

Gamoran, A., & Nystrand, M. (1990, July). Tracking. ins t>.-uction. and achievement Paper 
presented at the Word Congress of Sociology, Madrid, Spain, July 199C. (DRAFT) 

Praject 5. Research on Programs and Policies Affecting A t-risk Youth 

Wehlage, G^ Lipman. P., & Smith, G. (1990, August). A good school Madison, WI: 
National Center on Effective Secondary Schools. (DRAFT) 
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